american revolution
SPRI: Aligning Large Language Models with Context-Situated Principles
Zhan, Hongli, Azmat, Muneeza, Horesh, Raya, Li, Junyi Jessy, Yurochkin, Mikhail
Aligning Large Language Models to integrate and reflect human values, especially for tasks that demand intricate human oversight, is arduous since it is resource-intensive and time-consuming to depend on human expertise for context-specific guidance. Prior work has utilized predefined sets of rules or principles to steer the behavior of models (Bai et al., 2022; Sun et al., 2023). However, these principles tend to be generic, making it challenging to adapt them to each individual input query or context. In this work, we present Situated-PRInciples (SPRI), a framework requiring minimal or no human effort that is designed to automatically generate guiding principles in real-time for each input query and utilize them to align each response. We evaluate SPRI on three tasks, and show that 1) SPRI can derive principles in a complex domain-specific task that leads to on-par performance as expert-crafted ones; 2) SPRI-generated principles lead to instance-specific rubrics that outperform prior LLM-as-a-judge frameworks; 3) using SPRI to generate synthetic SFT data leads to substantial improvement on truthfulness. We release our code and model generations at https://github.com/honglizhan/SPRI-public.
How 'Hamilton' and other movies can spark a learning revolution
Mayra Leiva of Reseda, California, knew her eight-year-old son was a little interested in history. But she was surprised when all at once he became a walking encyclopedia, spouting dates and pretending every tire swing was a time machine. "It happened after he saw Night at the Museum," she says. I've had to do a lot of Googling to keep up!" Not many children will tell you that their favorite school subject is history. Memorizing dates and learning long-ago facts that don't seem relevant isn't exactly high on their fun list. Perhaps that's why pop culture--movies, music, television, and even video games and comic books--can be such useful teaching tools. "Teaching through pop culture helps students relate history to their own background and experiences," says Gail Hudson, a fifth-grade teacher and 2020 Nevada Teacher of the Year. "It's tying into something that's already caught their interest." Take the movie version of the Broadway show Hamilton, which releases on Disney July 3.